Jongmin Kim's profile

Hangul (the Korean alphabet) Meets AI

Hangul is one of the uniquely developed writing systems in the world. 

Each character possesses the ability to represent both sound and pronunciation, making it a design born from the harmony of language and speech. Even in the modern digital age, Hangul continues to shine from a UX perspective.

This project employs machine learning and WebGL to design the visual effects and interactions of Hangul characters. From rain falling from the sky ('비') to snow melting on the ground ('눈'), the sound of a waterfall ('콸콸'), and the sight of a roaring fire ('활활'), each work highlights the uniqueness and creativity of Hangul.
As my first project, I visualized the concept of '비' (rain) falling from the sky. 

I designed the character '비' (rain) to resemble raindrops falling from the sky and implemented machine learning to detect user hand movements. This allows users to control a virtual umbrella's movement. 

When raindrops hit the moving umbrella, it displays the realistic interaction of raindrops bouncing off, creating an engaging and lifelike experience.
My second project focuses on the concept of '눈' (snow). 

Snow is a natural phenomenon that we often encounter in our daily lives, similar to rain falling from the sky. However, rain and snow have very different visual characteristics.
While raindrops fall from the sky and bounce off surfaces, snow gently melts away when it comes into contact with the ground or objects. The key objective of this project was to beautifully visualize the melting process of snow.

The design of the '눈' character incorporates curved shapes and visual effects resembling snowflakes to naturally reflect the melting process. As users interact with '눈' and it comes into contact with the ground or objects, it gradually melts away, allowing users to experience the beauty and transformation of '눈'.
My third project explores the sound of water falling in a waterfall, represented by the Korean onomatopoeia '콸콸' (kkwal-kkwal). 

Hangul, with its scientific structure, allows us to transcribe almost all sounds in the world phonetically. This opens up intriguing possibilities, especially in the realm of onomatopoeia and mimetic words. This project leverages Korean's phonetic capabilities to experiment with the visual representation of sound.

In this project, the sound of '콸콸' mimicking the sound of water falling descends like a waterfall. When users interact with it and touch it, it transforms into water, and water droplets bounce, providing a visual representation of the sound.
My fourth project portrays the sight of a blazing fire with the onomatopoeia '활활' (hwal-hwal). 

I beautifully designed the image of a bonfire rising and disappearing into the air. To make it resemble fire, I put a lot of effort into adding details to the movement of this bonfire.
For example, at the beginning, large flames slowly rise, and as they turn into ashes and disappear into the sky, they shrink in size and vanish rapidly in proportion to their reduced weight.

In addition to this, I created an interaction where, when users touch it, the characters '활활' vanish like smoke in their hands.
In order to elevate the uniqueness of the Hangul project, I leveraged the power of the TensorFlow machine learning platform. This allowed us to implement a sophisticated gesture detection system, enabling users to engage with Korean characters in a more immersive and interactive manner.

Incorporating TensorFlow into the project not only enhanced its technical capabilities but also enriched the overall user experience. It brought a new dimension to the world of Korean characters, making them more accessible, interactive, and captivating for users of all ages and backgrounds.
The overall drawing for this project was implemented using WebGL, and significant effort was devoted to seamlessly portraying the splashing motion of raindrops.
Each character consists of a structure composed of numerous particles, and their positions were determined by utilizing the contrast and shading of the character drawn on the canvas. These particles were endowed with properties that make them bounce off like raindrops when they collide with objects.

Additionally, shaders were employed to design a visual effect that makes the raindrops appear like water.
Hangul (the Korean alphabet) Meets AI
Published:

Hangul (the Korean alphabet) Meets AI

Published: